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Background / Context: Description of prior research and its intellectual context. 

Evidence is clear that discipline in high school is associated with negative outcomes across the 
life course. Not only are suspensions related to declining academic trajectories during high 
school in the form of attendance and academic achievement, students suspended once are also 
more likely to be suspended again and also substantially increase the likelihood of dropping out 
of high school (Balfanz, Byrnes, & Fox, 2013; Ekstrom, Goertz, Pollack, & Rock, 1987; Losen 
& Martinez, 2013; Marchbanks III et ah, 2013; Morrison et ah, 2001). Through their influence 
on high-school success and the related increased potential for involvement with the criminal 
justice system, many scholars identify suspensions as the beginning of a life-course trajectory of 
deviance and negative outcomes (Balfanz, Spiridakis, Neild, & Legters, 2003; Belfield & Levin, 
2007; Pager, Western, & Sugie, 2009; Skiba et al., 2003). Additionally, adolescents as an age- 
group in particular are sensitive to structural changes and environmental influences making such 
negative institutional experiences particularly salient during the high school years (Furstenberg, 
2000; Harter, 1990; Mortimer, Oesterle, & Kruger, 2005; Roeser, Eccles, & Freedman-Doan, 
1999; Seidman & French, 2004). Important, the criminologists also identify the importance of 
institutions like schools, employment and marriage as potential levers for change in deviant 
trajectories highlighting the importance of institution-individual relationships (Laub, Nagin, & 
Sampson, 1998; Laub & Sampson, 1993, 2003; Moffitt, 1993; Weiss & Bearman, 2007). 
Structures within schools organize behavior and shape climate through the relationships and 
opportunities developed within these structures. Scholars across multiple fields have identified 
the importance of individual relationships between students, teachers and other school staff in the 
way climate influences outcomes above and beyond student attitudes or behavior (Skiba, 
Peterson, & Williams, 1997; Wu, Pink, Crain, & Moles, 1982). 

Purpose / Objective / Research Question / Focus of Study: Description of the focus of the research. 
The plethora of evidence highlighting negative impacts of suspension leaves little room for 
debate. However, with only a few studies explicitly examining the specific influence of schools 
on student discipline independent of student behavior itself, this problem guides the following 
analysis. Namely, it is unclear if students with greater behavioral problems drive greater use of 
discipline or if greater use of discipline simply belies larger institutional problems. In one case, 
differences in student behavior are the driving factor in variations in discipline rates at both the 
student- and school-level. For example, certain schools may enroll harder-to-serve populations 
with higher rates of behavioral problems before even entering the high school. In the second 
case, differences in school-level practices may influence variation in discipline rates at the 
student level regardless of student behavior. 

While studies on discipline focus on demographic characteristics of schools, they often do not 
account for more organizational context such as resources and climate. Substantial scholarship 
shows schools have different levels of resources and school climates and these are generally 
related to variation in academic outcomes (Bryk & Thum, 1989; Clotfelter, Ladd, Vigdor, & 
Wheeler, 2006; DiPrete & Mueller, 1981; Lee & Loeb, 2000; Loeb, Kalogrides, & Homg, 2010; 
Morrison et al., 2001; Rosigno, 1998; Rosigno & Ainsworth-Darnell, 1999); such variation in 
resources and climate is also likely related to disciplinary practice and outcomes. In an extensive 
correlational study using a national longitudinal dataset, DiPrete and Mueller (1981) find that a 
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variety of academic climate measures are strongly related to reduced rates of misbehavior, 
particularly for boys. More recent studies explicitly explore disciplinary and academic climates 
finding similar relationships to discipline (Arum, Beattie, Pitt, Thompson, & Way, 2003; Arum 
& Valez, 2012; Bryk & Thum, 1989; Morrison et ah, 2001). Overall, studies on school discipline 
rarely account for the unique policy climates to which schools are subject. School-level analyses 
often utilize national or state-level samples while failing to account for unique district and 
school-level policies (Arum & Valez, 2012; Skiba et al., 2013, 1997). Related, student-level 
analyses often report aggregate district or state-level discipline rates without accounting for the 
clustering of certain students into different school environments which likely influence a 
student’s likelihood of school discipline net the student’s own characteristics. 

It is clear that there is variation across schools in suspension rates, yet it is unclear if this is due 
to the sorting of certain students into certain schools or a result of different school practices. This 
analysis capitalizes on a natural transition in institutions to identify the way in which schools 
may influence student behavior throughout the high school trajectory. I utilize static 
characteristics and infonnation on students preceding their high school career to explore 
variations in a student’s risk of suspension during the first two years of high school. Specifically 
I ask: What is the “school effect ” on a student ’s likelihood of suspension in the first four 
semesters of high school? 

Setting: Description of the research location. 

Using a unique administrative dataset from a large, urban school district in the North East United 
States, I am able not just to estimate school-level variance, but also to examine some of the 
student and school-level characteristics that may account for such variance. The data proposed 
contains multiple observations for students and schools, over time and within a single district 
policy environment, including a) student-level academic and school participation information b) 
surveys of parents, teachers and students, and c) infraction-level suspension data by date. Each 
year of suspension data has roughly 36,000 suspensions district-wide and these students receive 
an average of just over 2.3 suspensions within a year and 2.7 infractions per year indicating that 
often a single suspension will be imposed for the combination of more than one infraction. 
(PLEASE INSERT TABLE 1 HERE, APPENDIX B) 

Suspension records exist for students in the 9-12 grades and ungraded students who are of age to 
be in high school but in ungraded programs 1 ) Ninth graders have a slightly higher average of 2.5 
suspensions than students in higher grades. 


Population / Participants / Subjects: Description of the participants in the study: who, how many, key 
features, or characteristics. 

I conduct this analysis with a single cohort of students who are in 9 th grade in the fall of 2009 
school year so as to follow them through their high-school career. This sample includes 
approximately 60,000 students with an average rate of suspension of 15%. The majority of these 
suspensions are for discretionary offenses (those not mandated for discipline by federal or state 


I exclude 2013 from this average as it has just under 30,000 suspensions— it is somewhat of an outlier and is 
excluded from later analysis. 

f I remove ungraded students from analysis as they are often in unique, “special education’’ schools and/or have 
6fliiaanDmiqiim^adad«lMdeixtisc£rienranalysis as they are often in unique, “special education’’ schools and/or have 
other unique educational experiences. 


SREE Spring 2015 Conference Abstract Template 


A-2 



law).As can be seen in Appendix B-Table 2, the patterns for suspended students broadly match 
existing literature. 

(INSERT TABLE 2, APPENDIX B HERE) 

For example, while Black students make up approximately 30 percent of this sample, they 
comprise more than 43 percent of students suspended once and 55 percent of students suspended 
more than once. Similarly, the rates of suspension for special education students are higher than 
would be expected*. Students who are suspended are also more likely to be chronic absentees 
and substantially more likely to be overage for their grade. 

Intervention / Program / Practice: N/A 


Research Design: Description of the research design. 

The use of an HLM strategy such as that used by Ready and Chu (2013) fails to carefully 
examine school-level variance only providing an empirical average of the school-effect on 
student suspension rates. I use quasi-experimental, propensity score matching techniques to 
identify similar students using middle-school academic and behavioral outcomes such as 
attendance and test scores (Rosenbaum & Rubin, 1983). This framework identifies students 
based on their likelihood (based on a logistic or Poisson regression model framework) to be 
suspended at any time during high school with the following model: 

Yij = Boj + Bjj,Xij + ji) 

In this model, I nest students (;) in their middle schools (j) and then estimate their likelihood of a 
high school suspension holding certain student characteristics constant. I nest students within 
middle-school to account for different discipline policies between middle-schools, which would 
impact both a student’s long-term suspension trajectory and other academic and behavioral 
outcomes before entering high school (S. Raudenbush & Bryk, 1986; S. W. Raudenbush & Bryk, 

2002) . Specifically, this model contains a vector of X,y including student demographic 
characteristics as well as attendance and academic characteristics from middle school. 

A second flaw in HLM analysis is its implicit assumption that all students remain in the sample 
throughout the period of analysis, or that the attrition is not important. This assumption does not 
address the possibility that occurrence of the ‘event’ may influence the likelihood of being in the 
sample at a later period and relatedly, of the event happening more than once. For example, a 
student who is suspended once in 9 th grade may be more likely to transfer schools or dropout as 
well as to be suspended a second time. After matching, I thus use an Event History (EHA) 
modeling framework for this analysis conceptually on a logistic regression framework but using 
a different data structure that not only allows for time -variant measures but, most importantly, 
adjusts measurement at each time point to take into account the changing population across time 
points. The analyses in this paper utilize a discrete -time hazard function that calculates the 
probability that an event will happen at time t or after time t to individual i (Singer and Willett, 

2003) . 

H(tij) = Pr[Ti=j | Ti>=j] (2) 


* Because Special Education and retained students are expected to have higher rates of suspension but are less likely 
to be included in a ‘first-time 9 th grader" cohort, I currently adjust the data so as to include all students in 9 th grade in 
2009 including those are in special education/ungraded but have grade 9 recorded on their suspension file. 
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In the above equation this probability is drawn from a basic logistic regression equation and does 
not include multi-level modeling*. This analytic strategy also eliminates the need for a multi- 
level model framework in which I include high school fixed effects as I am using attendance at a 
different high school as the ‘treatment’ in this analysis and calculating the difference between 
student risks of suspension for matched pairs to explicitly identify high school ‘effects.’ 

Data Collection and Analysis: Description of the methods for collecting and analyzing data. 

I employ an analytic strategy capitalizing on a longitudinal, administrative dataset for a large 
urban school district focusing on suspensions during the first two years of high school. A focus 
on the first two years of high school is driven by two empirical realities: first, the negative 
impact of a suspension is likely to be much stronger in earlier years of high school where it may 
influence both placement in academic tracks and peer groups (Balfanz et ah, 2013; Balfanz, 
Herzog, & Mac Iver, 2007; Balfanz et al., 2003; Morrison et ah, 2001; Skiba et al., 1997). Also, 
preliminary analysis of the data used in this paper suggests that the majority of students who will 
ultimately receive a suspension have received their first suspension by the 10 th grade (Table 1, 
Appendix B). 

I calculate the average risk of suspension once they reach high school using a logistic regression 
model. Once students’ risk of suspension has been calculated, I match students within a 
particular risk score band (eg 70-80% likely to be suspended) also using pre-high school 
characteristics. This approach allows me to examine the influence of a school on a student’s 
likelihood of suspension as if two students with equal likelihood of suspension were assigned to 
different schools. I then follow these students to different high schools and examine the variation 
in their observed outcomes (suspensions) over the first four semesters of high school based on 
high school characteristics. 


Findings / Results: Description of the main findings with specific details. 

Initial findings suggest significant between-school variation in student suspension rates even 
within this single district. 

(INSERT FIGURE 1 APPENDIX B HERE) 

As can be seen in the above figure, while the average suspension rate in this cohort’s final 
school-year was approximately 9.5%, the range of rates goes from 0-ahnost 50 percent in 2012. 
Also, (not shown here) descriptive analyses show substantial variation in school suspension rates 
by school size and the demographic characteristics of a school. 

Conclusions: Description of conclusions, recommendations, and limitations based on findings. 

The impact of organizational structures has a long empirical history of influence on individuals. 
Much of the literature on suspensions is unable to address variance in school-level discipline 
based on school-level characteristics due to data limitations. Capitalizing on a recent, large urban 
administrative dataset this analysis uses both analytic methods rarely used in the study of school 
discipline and exploits extensive information about schools and students to provide a deeper 
understanding of these more appropriately estimated school effects on student suspensions. 


§ Initial analyses have tested both fixed an random school-level effects in calculating logodds of suspension in an 
EH A framework and find little difference between the two methods. Further analysis of model fit will determine the 
final model specification. 


SREE Spring 2015 Conference Abstract Template 


A-4 



Appendices 

Not included in page count. 


Appendix A. References 

References are to be in APA version 6 format. 

Arum, R., Beattie, I., Pitt, R., Thompson, J., & Way, S. (2003). Judging School Discipline: The 
Crisis of Moral Authority in American Schools. Cambridge, MA: Harvard University 
Press. 

Arum, R., & Valez, M. (Eds.). (2012). Improving Learning Environments: School Discipline and 
Student Achievement in Comparative Perspective (Studies in Social Inequality) . Palo 
Alto, CA: Stanford University Press. 

Balfanz, R., Byrnes, V., & Fox, J. (2013). Sent Home and Put Off-Track: The Antecedents, 
Disproportionalities, and Consequences of Being Suspended in the Ninth Grade. 

Presented at the Closing the School Discipline Gap Conference, Washington D.C.: The 
Civil Rights Project. 

Balfanz, R., Herzog, L., & Mac Iver, D. (2007). Preventing Student Disengagement and Keeping 
Students on the Graduation Path in Urban Middle-Grades Schools: Early Identification 
and Effective Interventions. Educational Psychologist, 42(4), 223-235. 

Balfanz, R., Spiridakis, K., Neild, R., & Legters, N. (2003). Neighborhood High Schools and the 
Juvenile Justice System: How Neither Helps the Other and How That Could Change. 

Belfield, C. R., & Levin, H. M. (2007). The Price We Pay: Economic and Social Consequences 
of Inadequate Education. Washington, D.C.: Brookings Institution Press. 

Bryk, A., & Thum, Y. M. (1989). The Effects of High School Organization on Dropping Out: An 
Exploratory Investigation. American Educational Research Journal, 26(3), 353-383. 

Clotfelter, C., Ladd, H. F., Vigdor, J., & Wheeler, J. (2006). High Poverty Schools and the 

Distribution of Teachers and Principals. Retrieved from file:///Q:/QMSS/Chris, Christy 
Vanessa Work/Winter 2010.Data/PDF//SAN06-08-1980346880/SAN06-08.pdf 

DiPrete, T., & Mueller, C. W. (1981). Discipline and Order in American High Schools 

(Research/Technical No. NCES-82-202). Washington D.C.: National Opinion Research 
Center. 

Ekstrom, R., Goertz, M., Pollack, J., & Rock, D. (1987). Who Drops Out of High School and 
Why? Findings from a National Study. New York: Educational Testing Service. 

Furstenberg, F. (2000). The Sociology of Adolescence and Youth in the 1990s: A Critical 
Commentary. Journal of Marriage and the Family, 62(4), 896-910. 

Harter, S. (1990). Self & Identity Development. In S. Feldman & G. R. Elliot (Eds.), At the 
Threshold: The Developing Adolescent. Cambridge, MA: Harvard University Press. 

Laub, J. H., Nagin, D. S., & Sampson, R. J. (1998). Trajectories of criminal offending: Good 
marriages and the desistance process. American Sociological Review, 63(2), 225-41. 

Laub, J. H., & Sampson, R. J. (1993). Turning Points in the Life Course: Why Change Matters to 
the Study of Crime. Criminology, 31(2), 301-326. 

Laub, J. H., & Sampson, R. J. (2003). Shared Beginnings, Divergent Lives: delinquent boys to 
age 70. Cambridge, MA: Harvard University Press. 

Lee, V., & Loeb, S. (2000). School Size in Chicago Elementary Schools: Effects on Teachers’ 

Attitudes and Students’ Achievement. American Educational Research Journal, 37(1), 3- 
31. 


SREE Spring 2015 Conference Abstract Template 


A-5 



Loeb, S., Kalogrides, D., & Homg, E. L. (2010). Principal Preferences and the Uneven 

Distribution of Principals Across Schools. Educational Evaluation and Policy Analysis, 
32(2), 205-229. 

Losen, D., & Martinez, T. E. (2013). Out of School & Off Track: The Overuse of Suspensions in 
American Middle and High Schools. The Civil Rights Project. 

Marchbanks III, M. P., Blake, J. J., Booth, E. A., Carmichael, D., Seibert, A. L., & Fabelo, T. 
(2013). The Economic Effects of Exclusionary Discipline on Grade Retention and High 
School Dropout. Presented at the Closing the School Discipline Gap Conference, 
Washington D.C.: The Civil Rights Project. 

Moffitt, T. E. (1993). Adolescence-Limited and Life-Course-Persistent Antisocial-Behavior - a 
Developmental Taxonomy. Psychological Review, 100(4), 674-701. 

Morrison, G., Anthony, S., Storino, M. H., Cheng, J. J., Furlong, M. J., & Morrison, R. L. 

(2001). School expulsion as a process and an event: Before and after effects on children 
at risk for school discipline. In R. J. Skiba & G. G. Noam (Eds.), Zero-Tolerance: Can 
Suspension and Expulsion Keep Schools Safe?. Jossey-Bass Publishers. 

Mortimer, J., Oesterle, S., & Kruger, H. (2005). The Structure of the Life Course: Standardized? 
Individualized? Differentiated? Advances in Life Course Research, 9, 175-203. 

Pager, D., Western, B., & Sugie, N. (2009). Sequencing Disadvantage: Barriers to Employment 
Facing Young Black and White Men with Criminal Records. Annals of the American 
Academy of Political and Social Science, 623, 195-213. 

Raudenbush, S., & Bryk, A. (1986). A Hierarchical Model for Studying School Effects. 
Sociology of Education, 59(January), 1-17. 

Raudenbush, S. W., & Bryk, A. (2002). Heirarchical Linear Models: Applications and Data 
Analysis Methods (Vol. Second). Thousand Oaks, CA: Sage Publications. 

Roeser, R. W., Eccles, J. S., & Freedman-Doan, C. (1999). Academic functioning and mental 
health in adolescence: Patterns, progressions, and routes from childhood. Journal of 
Adolescent Research, 14(2), 135-174. 

Rosenbaum, J., & Rubin, D. B. (1983). The central role of the propensity score in observational 
studies for causal effects. Biometria, 76(1), 41-55. 

Rosigno, V. J. (1998). Race and the Reproduction of Educational Disadvantage. Social For, 
76(3), 1033-1061. 

Rosigno, V. J., & Ainsworth-Darnell, J. (1999). Race, Cultural Capital, and Educational 

Resources: Persistent Inequalities and Achievement Returns. Sociologv of Education, 72, 
158-178. 

Seidman, E., & French, S. E. (2004). Developmental trajectories and ecological transitions: A 
two-step procedure to aid in the choice of prevention and promotion interventions. 
Development and Psychopathology, 16(4), 1141-1159. 

Skiba, R. J., Peterson, R., & Williams, T. (1997). Office Referrals and Suspension: Disciplinary 
Intervention in Middle Schools. Education and Treatment of Children, 20(3), 295-315. 

Skiba, R. J., Simmons, A., Staudinger, L., Rausch, M., Dow, B., & Feggins, R. (2003). Constent 
Removal: Contributions of School Discipline to the School-Prison Pipeline. Presented at 
the School to Prison Pipeline Conference: Harvard Civil Rights Project. 

Skiba, R. J., Trachok, M., Chung, C.-G., Baker, T., Sheya, A., & Hughes, R. (2013). Where 

Should We Intervene? Contributions of Behavior, Student, and School Characteristics to 
Suspension and Expulsion. Presented at the Closing the School Discipline Gap 
Conference, Washington D.C.: The Civil Rights Project. 


SREE Spring 2015 Conference Abstract Template 


A-6 



Weiss, C. C., & Bearman, P. (2007). Fresh starts: Reinvestigating the effects of the transition to 
high school on student outcomes. American Journal of Education, 113(3), 395-421. 

Wu, S. C., Pink, W. T., Crain, R. L., & Moles, O. (1982). Student suspension: A critical 
reappraisal. Urban Review, 14, 245-303. 


SREE Spring 2015 Conference Abstract Template 


A-7 



Appendix B. Tables and Figures: Not included in page count. 
Appendix Table 1: Student-level Suspension Variation 


Per Student (2009-2012) 

Grade 9 

Grade 10 

Grade 11 

Grade 12 

Average Number of Suspensions per Student 

2.58 

2.30 

1.95 

1.75 

Average Number of Mandatory Suspensions 

0.20 

0.18 

0.18 

0.18 

Average Number of Aggressive Suspensions 

0.93 

0.85 

0.75 

0.68 

Average Number of Low-level Suspensions 

1.33 

1.18 

1.00 

0.88 

Average Number of Unique Students Suspended 

9772 

7765 

4002 

2642 

Average Number of Suspensions by Grade 

16043 

11821 

5584 

3442 


Appendix Table 2: 2009 Cohort Suspension Analysis* 

Percent within Suspension Type 



Average 

Never 

Once 

> Once 

Discretionary 

Mandatory 

Demographics 

Gender 

Female 

51.4 

53.1 

43.7 

39.1 

42.2 

37.1 

Ethnicity 

Hispanic 

37.5 

37.6 

39.2 

33.4 

36.2 

41.9 

Black 

30.2 

26.9 

43.3 

55.2 

48.7 

44.6 

White 

14.0 

14.9 

9.7 

7.5 

8.8 

8.0 

Asian 

17.8 

20.0 

7.3 

3.4 

5.7 

5.0 

Other 

0.5 

0.5 

0.5 

0.5 

0.5 

0.5 

Socio-Economic 

Characteristics 

One or More Poverty 
Indicators 

65.1 

64.0 

69.9 

73.0 

71.0 

73.8 

English Language 
Learner 

7.0 

7.1 

6.9 

5.8 

6.5 

5.7 

Home Language 
Not English 

46.4 

49.1 

35.6 

26.8 

31.7 

34.0 

Special Education 
Student 

9.9 

8.8 

13.5 

18.6 

15.8 

14.2 

Grade 8 Academics 
Enrolled in Public 
School 

92.2 

91.9 

93.5 

93.6 

93.6 

92.7 

Attendance Rate 

91.3 

91.5 

90.4 

89.0 

89.8 

89.4 

Chronic Absentee 

3.9 

3.3 

5.8 

9.2 

7.2 

8.4 

Grade 8 ELA 
(zscore) 

0.0 

0.0 

0.1 

0.1 

0.1 

0.1 

Grade 8 Math 
(zscore) 

0.0 

0.0 

0.1 

0.1 

0.1 

0.1 

Overage for Grade 9 

24.6 

23.3 

29.6 

34.7 

31.6 

33.1 

Number of Students 

60832 

51428 

5432 

3972 

8512 

892 

% of Sample 

100% 

85% 

9% 

7% 

14% 

1% 


*Not all percentages add up to 100 due to rounding 
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Percent 


Appendix Figure 1: Variation in School-level Suspension Rates in 2012 


Distribution of PCTSUS 



Cuive Normal(Mu=9 6537 Sigma=7 8286) 
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